Skip to content

Parser via tree sitter #46

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 126 commits into
base: main
Choose a base branch
from
Draft

Parser via tree sitter #46

wants to merge 126 commits into from

Conversation

istathar
Copy link
Member

@istathar istathar commented Jul 4, 2025

Initial work to construct a front-end parser. This version attempts to use Tree Sitter based on the recommendation of several colleagues. Builds on the work in place in #45 but we'll see how much of that ends up being re-used.

@istathar
Stub module for parsing
8df238c
@istathar
Add pest dependency
48a0ae9
@istathar
Grammar for procedure declaration
1e440ea
@istathar
Type is a reserved word so call types typas
5fb162a
@istathar
Handle multiple types in domain
163c33b
@istathar
Add parser test using macro
024a6d0
@istathar
Rename type again, to forma
31b2873
@istathar
Pass input file to parser when checking
c2ae2e8
@istathar
Grammar for header lines in a Technique file
35ca520
@istathar
Reconsider place of newlines in grammar
9a7abaa
@istathar
Test copyright string on spdx line
2132ef4
@istathar
Grammar for template line in header
08d1e04
@istathar
Additional year tests
73a2427
@istathar
Additional license tests
900077e
@istathar
Test identifiers and declarations
e7da2c1
@istathar
Add winnow parser dependency
8f59595
@istathar
Reimplement identifier parser
df2cbea
@istathar
Improve parse_identifier to enforce first character
47ce870
@istathar
Use verify to ensure identifier parse is valid
61502e2
@istathar
Add chumsky parser dependency
244a9db
@istathar
Reimplement identifier parser again
bb5d9ff
@istathar
Parse magic line
33aa001
@istathar
Parse license and copyright header parts
b32204d
@istathar
Complete SPDX header line parser
f15e592
@istathar
Parse template line
410cdcc
@istathar
Add lalrpop parser dependency
a7669de
@istathar
Setup
1fd1ae7
@istathar
Parse identifiers
3e6bc27
@istathar
Parse magic line
476055b
@istathar
Redo lexer declaration with match
5a1c45d
istathar added 29 commits June 15, 2025 18:39
@istathar
Parse Forma out of a tuple Genus
ee23087
@istathar
Initial handling of a unit type as a Genus
3211d6d
@istathar
Ensure parsed characters consumed from input
dca981f
@istathar
Separate test for unit Genus
73da1b3
@istathar
Upgrade Identifier to tuple struct
f4d968b
@istathar
Upgrade Forma and Attribute to tuple structs
263d404
@istathar
Fix missing offset update
35e4ded
@istathar
Move Genus parsing logic to validate_genus() in types
3ed609b
@istathar
Implement Signature parsing
c66c3ef
@istathar
Remove ununsed code
0d9708c
@istathar
Add test cases for Procedure declarations
0f528a5
@istathar
Avoid warning
13a0587
@istathar
Separate Forma and Genus tests
d9b58f7
@istathar
Significant refactoring to nested parsers
3254ae1
@istathar
Add try_using_regex() for Optional matches
42e5fa3
@istathar
Add Tree Sitter dependencies
d563e09
@istathar
Add machinery to compile parser on build
ec8570a
@istathar
Preliminary Tree Sitter grammar to parse a procedure declaration
c3fa95a
@istathar
Add generated Tree Sitter parser
b35c1ba
@istathar
Add file metadata controls
5b2d0fa
@istathar
Refactor to handle newline behaviours
c6a3eb1
@istathar
Temporary wrapper to use Tree Sitter parser
34aa500
@istathar
Handle Genus and Forma
f1b5df9
@istathar
Handle empty tuple as Unit Forma
8ed2fe7
@istathar
Recognize header block
34ebf48
@istathar
Handle internal complexity of SPDX line
acb6ddc
@istathar
Move test cases into module
6f51dfc
@istathar
Be more permissive with whitespace, solving parsing issues
3bc99c1
@istathar
Update tests to reflect proecdure bodies
79e8259
@istathar istathar self-assigned this Jul 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@istathar istathar

Labels
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@istathar